Multiwave dental imaging system

ABSTRACT

An imaging system comprises multiple light sources, a beam combiner, an optical array sensor, and a computing device. A first light source forms a first beam of light at a first wavelength. A second light source forms a second beam of light at a second wavelength. The beam combiner combines the first beam of light and the second beam of light into a single beam of light and illuminates a specimen with the single beam of light. The optical array sensor detects reflected light that is reflected from the specimen. The computing device accesses sensor data from the optical array sensor, forms a first image based on the first wavelength and a second image based on the second wavelength, and forms a composite image from the first image and the second image.

CROSS-REFERENCE TO RELATED APPLICATIONS

The present application claims priority to U.S. Provisional PatentApplication Ser. No. 62/799,920, filed Feb. 1, 2019, which is herebyincorporated by reference in its entirety.

TECHNICAL BACKGROUND

The subject matter disclosed herein generally relates to the processingof data. Specifically, the present disclosure addresses systems andmethods for processing multiple images generated at different opticalwavelengths.

BACKGROUND

Current dental imaging technique require expensive equipment andtime-consuming processes to identify tooth structure and cariesproperties. There is a need to provide accurate diagnostic information(that dictate appropriate treatment options given established clinicalcriteria) with less prohibitive cost.

BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWINGS

To easily identify the discussion of any particular element or act, themost significant digit or digits in a reference number refer to thefigure number in which that element is first introduced.

FIG. 1 illustrates a network environment for operating an imaging systemin accordance with one example embodiment.

FIG. 2 illustrates an imaging system in accordance with one exampleembodiment.

FIG. 3 illustrates an example operation of the imaging system inaccordance with one embodiment.

FIG. 4 illustrates an example operation of another imaging system inaccordance with another example embodiment.

FIG. 5 illustrates an example of reconstructing a composite image inaccordance with one example embodiment.

FIG. 6 is a flow diagram illustrating the path of image data acquisitionusing the present imaging system in accordance with one exampleembodiment.

FIG. 7 is a flow diagram illustrating a method for forming a compositeimage in accordance with one example embodiment.

FIG. 8 is a flow diagram illustrating a method for forming a compositeimage in accordance with one example embodiment.

FIG. 9 is a flow diagram illustrating a method for identifying an areaof interest in the composite image from images of different wavelengths.

FIG. 10 is a flow diagram illustrating a method for generating amultimodal 3D overlay of diagnostic information in accordance with oneexample embodiment.

FIG. 11 illustrates a routine in accordance with one example embodiment.

FIG. 12 illustrates a routine in accordance with one example embodiment.

FIG. 13 is a diagrammatic representation of a machine in the form of acomputer system within which a set of instructions may be executed forcausing the machine to perform any one or more of the methodologiesdiscussed herein, according to one example embodiment.

DETAILED DESCRIPTION

Example methods and systems are directed to a method for multi-wavedental imaging. In one example embodiment, the present applicationdescribes a single pixel camera used in conjunction with an array ofphotodiodes (or a high speed spectrometer) to produce data streams usedto simultaneously reconstruct multimodal images. In another exampleembodiment, the present application describes multiple cameras used inconjunction with a multi-wave light source. Each camera is configured todetect a predefined wavelength. The data stream from the cameras can beused to reconstruct multimodal images.

The present application describes a method to create a multimodaldigital diagnostic map of a patient's oral dentition and surroundinggingival tissue using a digital micro-mirror device (DMD) single pixelcamera. This method is intended for caries detection, but it can also beused for other types of dental/medical treatments by leveragingdifferent wavelengths.

In one example embodiment, an imaging system comprises a first lightsource, a second light source, a beam combiner, an optical array sensor,and a computing device. The first light source forms a first beam oflight at a first wavelength. The second light source forms a second beamof light at a second wavelength. The beam combiner combines the firstbeam of light and the second beam of light into a single beam of lightand illuminates a specimen with the single beam of light. The opticalarray sensor detects reflected light that is reflected from thespecimen. The computing device accesses sensor data from the opticalarray sensor, forms a first image based on the first wavelength and asecond image based on the second wavelength, and forms a composite imagefrom the first image and the second image. In one example embodiment,the image system comprises at least two light sources, each of differentwavelengths.

In another example embodiment, a non-transitory machine-readable storagedevice may store a set of instructions that, when executed by at leastone processor, causes the at least one processor to perform the methodoperations discussed within the present disclosure.

Examples merely typify possible variations. Unless explicitly statedotherwise, components and functions are optional and may be combined orsubdivided, and operations may vary in sequence or be combined orsubdivided. In the following description, for purposes of explanation,numerous specific details are set forth to provide a thoroughunderstanding of example embodiments. It will be evident to one skilledin the art, however, that the present subject matter may be practicedwithout these specific details.

FIG. 1 is a network diagram illustrating a network environment 100suitable for operating a mobile imaging device 106, according to someexample embodiments. The network environment 100 includes an imagingsystem 114 and a server 110, communicatively coupled to each other via anetwork 104. The imaging system 114 and the server 110 may each beimplemented in a computer system, in whole or in part, as describedbelow with respect to FIG. 13.

The server 110 may be part of a network-based system. For example, thenetwork-based system may be or include a cloud-based server system thatprovides additional information, such as three-dimensional models ofspecimens, to the mobile imaging device 106.

FIG. 1 illustrates a user 102 using the imaging system 114. The user 102may be a human user (e.g., a human being), a machine user (e.g., acomputer configured by a software program to interact with the mobileimaging device 106), or any suitable combination thereof (e.g., a humanassisted by a machine or a machine supervised by a human). The user 102is not part of the network environment 100, but is associated with theimaging system 114 and may be a user 102 of the imaging system 114.

The imaging system 114 includes a mobile imaging device 106 and a localcomputing device 112. The mobile imaging device 106 may include an imagecapturing device that is configured to illuminate the physical object108 (e.g., a specimen such as a tooth) at different wavelengths (e.g.,visible light range, 900 nm range, and 1450 nm range) and detect lightreflected from the physical object 108.

The local computing device 112 may be a computing device with a displaysuch as a smartphone, a tablet computer, or a laptop computer. The user102 may be a user of an application in the local computing device 112.The application may include an imaging application configured to detectand identify a region of interest (e.g., cavities) at the physicalobject 108 and provide a visualization of the region of interest (e.g.,indicated in a multi-wave reconstructed composite image) to the user102.

The mobile imaging device 106 is capable of tracking its relativeposition and orientation in space. For example, the mobile imagingdevice 106 includes optical sensors (e.g., depth-enabled 3D camera,image camera), inertial sensors (e.g., gyroscope, accelerometer),wireless sensors (Bluetooth, Wi-Fi), and GPS sensor, to determine thelocation of the mobile imaging device 106 within a real worldenvironment. The mobile imaging device 106 is described further belowwith respect to FIG. 2.

Any of the machines, databases, or devices shown in FIG. 1 may beimplemented in a general-purpose computer modified (e.g., configured orprogrammed) by software to be a special-purpose computer to perform oneor more of the functions described herein for that machine, database, ordevice. For example, a computer system able to implement any one or moreof the methodologies described herein is discussed below with respect toFIG. 9 to FIG. 11. As used herein, a “database” is a data storageresource and may store data structured as a text file, a table, aspreadsheet, a relational database (e.g., an object-relationaldatabase), a triple store, a hierarchical data store, or any suitablecombination thereof. Moreover, any two or more of the machines,databases, or devices illustrated in FIG. 1 may be combined into asingle machine, and the functions described herein for any singlemachine, database, or device may be subdivided among multiple machines,databases, or devices.

The network 104 may be any network that enables communication between oramong machines (e.g., server 110), databases, and devices (e.g., mobileimaging device

106). Accordingly, the network 104 may be a wired network, a wirelessnetwork (e.g., a mobile or cellular network), or any suitablecombination thereof. The network 104 may include one or more portionsthat constitute a private network, a public network (e.g., theInternet), or any suitable combination thereof.

FIG. 2 is a block diagram illustrating modules (e.g., components) of theimaging system 114, according to some example embodiments. The imagingsystem 114 comprises sensors 202, a display 204, a storage device 206, aprocessor 208, a multi-wave imaging application 210, an optical sensors212, a lighting system 214, an inertial sensor 216, a light sources 218,and a DMD system 220.

The lighting system 214 includes light sources 218 and DMD system 220.The light sources 218 generate light at different spectral ranges (e.g.,visible light range, 900 nm range, and 1450 nm range). In one exampleembodiment, the light sources 218 combines the light (e.g., light beam)from the different light sources 218 into a single beam and directs thesingle beam towards to the DMD system 220. The DMD system 220 includes aDMD array 222 and a DMD controller 224. The DMD controller 224 controlsthe DMD array 222 to project a pattern onto the physical object 108.

The sensors 202 include optical sensors 212 and an inertial sensor 216.The optical sensors 212 is configured to detect light reflected from thephysical object 108. In one example, the optical sensors 212 include aphotodiode array. In another example, the optical sensors 212 includemultiple two-dimensional photo arrays sensor. Each sensor is configuredto detect a predefined spectral range via a corresponding wavelengthselective mirror.

The inertial sensor 216 includes, for example, a gyroscope or anaccelerometer.

The processor 208 includes a multi-wave imaging application 210. Themulti-wave imaging application 210 is configured to control the lightingsystem 214 and access sensor data from sensors 202. The multi-waveimaging application 210 generates an image for each wavelength based onthe data steam from the sensors 202. The multi-wave imaging application210 analyzes an image (corresponding to a predefined wavelength),detects and identifies a region of interest (e.g., carries) in the imageobtained at the predefined wavelength. The multi-wave imagingapplication 210 generates a composite image based on the differentwavelength images. The composite image includes a visual indication ofthe region of the interest.

In one example embodiment, the imaging system 114 may communicate overthe network 104 with the server 110 to retrieve a portion of a databaseof visual references (e.g., images from different specimens).

Any one or more of the modules described herein may be implemented usinghardware (e.g., a processor of a machine) or a combination of hardwareand software. For example, any module described herein may configure aprocessor to perform the operations described herein for that module.Moreover, any two or more of these modules may be combined into a singlemodule, and the functions described herein for a single module may besubdivided among multiple modules. Furthermore, according to variousexample embodiments, modules described herein as being implementedwithin a single machine, database, or device may be distributed acrossmultiple machines, databases, or devices.

FIG. 3 illustrates an example operation of an imaging system 300 inaccordance with one embodiment. The imaging system 300 comprises a DMDarray 222, a DMD controller 224, a photodiode array 302, a photodiodearray 304, a specimen 306, a light source lambda1 308, a lesion 310, alight source lambda2 312, a light source lambda3 314, a beam combiner316, and the local computing device 112. In the present embodiment,light of different wavelengths are combined and reflected from the DMDarray to the specimen in a known projected pattern. Light reflected fromthe specimen is captured by photodiode arrays and reconstructed into acomposite image on a computer. FIG. 3 illustrates three light sources.Other example embodiments include two or more light sources, where eachlight source generates a light in a different wavelength range.

The light sources (one or more wavelengths) are directed at the specimen306 (e.g., tooth). The light source lambda1 308 generates a wavelengthin the human-visible light spectrum, for example, of about 380 nm toabout 740 nm to provide tooth surface information. Light source lambda2312 generates a wavelength within the infrared spectrum, for example, ofabout 700 nm to about 1 mm to provide caries and dentin surfaceinformation. Light source lambda3 314 generates a wavelength also withinthe infrared spectrum, for example, of about 700 nm to 1 mm to providecaries information. In another example embodiment, 2500 nm can be usedinstead of 1 mm for light source lambda3 314.

The light beams from light source lambda1 308, light source lambda2 312,light source lambda3 314 are combined using a beam combiner 316 (e.g.,partially transparent mirrors) to generate a single beam. In oneexample, polarizers filter the single beam and reduce specularreflectance. The single beam is directed towards the DMD array 222.

The local computing device 112 controls the DMD array 222 via the DMDcontroller 224. The DMD contains an array of small individuallycontrolled mirrors. The DMD array 222 directs a projected pattern at thespecimen 306. In one example, the DMD array 222 sequentially projectslight onto the specimen 306.

The photodiode array 304 detect light reflected from the specimen 306.The photodiode array 304 consist of one or more photodiodes. One or morephotodiodes corresponds to a different wavelength. The photodiode array302 and photodiode array 304 are placed at predefined locations relativeto the DMD array 222 (and/or the light source lambda1 308, light sourcelambda2 312, and light source lambda3 314).

The local computing device 112 accesses the analog data stream combinedwith the timing information sent to the DMD controller 224. The localcomputing device 112 reconstructs an image for each light source basedon the timing information. For example, at t1, the local computingdevice 112 determines that the light captured at photodiode array 302 isbased on light source lambda1 308. At t1+delta1, the local computingdevice 112 determines that the light captured at photodiode array 302 isbased on light source lambda2 312. At t1+delta2, the local computingdevice 112 determines that the light captured at photodiode array 302 isbased on light source lambda3 314. The local computing device 112provides the timing information (e.g., t1, delta1, delta2) to the DMDcontroller 224.

The local computing device 112 generates a composite image that combinesthe images based on each light source (e.g., light source lambda1 308,light source lambda2 312, light source lambda3 314). The local computingdevice 112 identifies a lesion 310 on the image based on one of thelight sources. The local computing device 112 indicates the lesion 310in the composite image. The composite image registers a same pixellocation in the composite image for each image based on each lightsource. For example, a pixel in a first image corresponds to a samepixel location in a second image. In other words, the images superimposeone another and are a direct location match to each other. There is noneed to shift or transpose one image onto another to match them.

It is noted that the DMD array 222, corresponding DMD controller 224,and a single photodiode (e.g., light sources 218) are significantlycheaper than equivalent sensor arrays that are used in cameras for nearinfrared (NIR) wavelengths.

FIG. 4 illustrates an example operation of an imaging system inaccordance with another example embodiment. The imaging system 400comprises a specimen 402, a multispectral light source 404, amultispectral light source 406, a lens 408, a mirror 410, a mirror 412,a mirror 414, a 2D photo array 416, a 2D photo array 418, and a 2D photoarray 420. In the present embodiment, multispectral light is reflectedoff of a specimen, separated via wavelength selective mirrors, projectedinto wavelength-specific 2D photo sensors, and reconstructed into acomposite image on the computer.

The multispectral light source 404 and multispectral light source 406(from human-visible light to infrared light) are directed at thespecimen 402 (e.g., tooth). The lens 408 combines lights reflected fromthe specimen 402. The lens 408 can include an optical filter withdifferent aperture and/or a polarizer. The lens 408 combine thereflected light into a single beam of light.

The single beam of light is directed at several mirrors (e.g., mirror410, mirror 412, mirror 414). Each mirror may include a partiallytransparent mirror that filters the reflected light at a predefinedwavelength range (e.g., mirror 410 may filter the single beam of lightfor visible light spectrum, mirror 412 may filter the single beam oflight for infrared light spectrum). Each mirror is directed to reflectthe filtered light to a corresponding photo array (e.g., mirror 410reflects filtered light to 2D photo array 416, mirror 412 reflectsfiltered light to 2D photo array 420, mirror 414 reflects filtered lightto 2D photo array 418). Each photo array is configured to detect lightat a wavelength corresponding to the mirror.

The multi-wave imaging application 210 accesses the data stream from the2D photo array 416, 2D photo array 420, and 2D photo array 418. Themulti-wave imaging application 210 generates an image based on thesensor data from each photo array. For example, the multi-wave imagingapplication 210 generates a first image based on the sensor data from 2Dphoto array 416. The multi-wave imaging application 210 generates asecond image based on the sensor data from 2D photo array 420. Themulti-wave imaging application 210 generates a third image based on thesensor data from 2D photo array 418.

In one example embodiment, the multi-wave imaging application 210generates a composite image that combines the first, second, and thirdimages. The multi-wave imaging application 210 identifies a lesion 310in one of the images based on its corresponding light source. Themulti-wave imaging application 210 indicates the lesion 422 in thecomposite image. The composite image registers a same pixel location inthe composite image for each image based on each light source.

FIG. 5 illustrates an example of reconstructing a composite image inaccordance with one example embodiment. The reconstruction process 500comprises a caries 502, an enamel 504, a dentin 506, a visible lightimage 508, a 900 nm image 510, a 1450 nm image 512, a reconstructedcomposite image 514, an external tooth shape diagram 516, adentin-enamel junction diagram 518, a dental caries diagram 520, and areconstructed diagram 522.

Spectral information obtained from each photodiode is superimposed toreconstruct a composite image illustrating the external tooth shape,dentin-enamel junction, and dental caries. The reconstructed compositeimage 514 represents the visible light image augmented-with dataextracted from the other wavelengths, specifically showing where thedecay is in relationship to the dentin-enamel junction. The dentalcaries is detected in 1450 nm image 512 and dental caries diagram 520.The multi-wave imaging application 210 visually identifies/indicates thecarries in the reconstructed composite image 514.

FIG. 6 is a flow diagram illustrating a method 600 of the imaging systemin accordance with one example embodiment. At operation 602, thereflected light from the physical object 108 is captured at the DMDarray 604. The DMD controller 606 controls the direction of each mirrorsin the DMD array 604 based on time information for each activatedmicromirror pixel 640. At operation 608, the photons (located from asingle pixel) are detected in an array of photodiodes at operation 610.The photodiodes detect different data stream (each being based on apredefined wavelength): intensity data stream 612, intensity data stream614, and intensity data stream 616.

A data container 618 stores the different data streams. In one example,the storage device 206 include the data container 618. A reconstructionalgorithm 620 processes the different data streams. For example, thereconstruction algorithm 620 generates a first image 622 based on theintensity data stream 612, a second image 624 based on the intensitydata stream 614, and a third image 626 based on the intensity datastream 616.

The reconstruction algorithm 620 combines the first image 622, secondimage 624, and third image 626 into a multimodal image set 628. In oneexample, image segmentation and detection 630 is performed on themultimodal image set 628 to identify regions of interest (e.g.,carries). The different images are combined into a multimodal overlaydental images 632.

A 3D reconstruction algorithm 634 uses a plurality of images 636 togenerate a 3D model at operation 638.

The following illustrates an example implementation of the method 600:

The imaging system simultaneously captures multiple images (2D or 3D)with identical (or substantially similar) perspectives (thus eliminatingthe need for registration steps) in multiple wavelengths. Thestructural/diagnostic data are extrapolated or identified from themultiple images with identical perspectives. The multiple images (withidentical perspective) are integrated together to generate a compositeimage that is used to identify regions of interest within the compositeimage. In one example, the light source lambda1 308 uses wavelengths of300 to 700 nm to generate tooth surface information. The light sourcelambda2

312 uses wavelengths from 701 nm to 1400 nm to generate caries anddentin surface information. The light source lambda3 314 useswavelengths from 1401 nm to 1 mm to generate caries only information (if1 mm is too big, can do 2500 nm).

In one example embodiment, the 2D images are taken sequentially use(on/off). In another example, embodiment, 3D images are generated basedon multiple single-pixel detectors placed in different locations. Eachsingle-pixel detector generates a 2D images. The 2D images are combinedto produce a 3D image. For example, the surface gradient of a tooth canbe generated based on the 2D images generated by the single-pixeldetector placed at known distinct locations (different x and ydirections). The surface gradients are integrated to reconstruct a 3Dmodel of the tooth.

Incoming light from the specimen is sequentially projected in apredetermined pattern by the DMD onto a photodiode array: The simplestpattern is to activate each individual micro-mirror pixel directly ontothe photodiode. Mathematical patterns can be used to approximate animage. Voltage(s) of the photodiode array indicating photon density overtime is fed into the computer.

A reconstruction algorithm using the prior knowledge of the patterncreates an image for each photodiode wavelength: for reconstructedimages, the analogous images taken at different wavelengths areregistered.

The inherent registration of each image can lend itself to producediagnostic overlays (e.g. overlay image). Segmentation techniques thatidentify caries (e.g. scattering intensity of reflected photons) can beoverlaid with visible light images. Given a plurality of images, it ispossible to generate a 3D overlay model of the tooth and the dentaldecay within.

FIG. 7 is a flow diagram illustrating a method 700 for forming acomposite image in accordance with one example embodiment. At block 702,the beam combiner 316 combines a beam from a plurality of light sourcesof different wavelengths. At block 704, the beam combiner 316 aims thebeam at a DMD array 604. At block 706, the DMD array 222 forms a patternfrom the beam. At block 708, the DMD array 222 projects the pattern onthe physical object 108. At block 710, the photodiode array 302 detectslight reflected off the physical object 108. The local computing device112 forms images based on the data signal and the DMD time information.At block 712, the local computing device 112 forms a composite imagefrom the plurality of images.

FIG. 8 is a flow diagram illustrating a method 800 for forming acomposite image in accordance with one example embodiment. At block 802,a multispectral light source 404 (deleted) forms a multispectral beam oflight. At block 804, the multispectral light source 404 (deleted) aimsthe multispectral beam of light at the specimen 402 (deleted). At block806, the mirror 410 (deleted) filters light reflected from the specimen402 (deleted). At block 808, the 2D photo array 416 (deleted) capturesthe filtered light from the mirror 410 (deleted). At block 810, themulti-wave imaging application 210 forms a first image with data fromthe 2D photo array 416 (deleted). At block 812, the mirror 412 (deleted)filters light reflected from the specimen 402 (deleted). At block 814,the 2D photo array 420 (deleted) captures the filtered light from themirror 412 (deleted). At block 816, the multi-wave imaging application210 forms a second image with data from the 2D photo array 420(deleted). At block 818, the multi-wave imaging application 210 forms acomposite image from the first and second image.

FIG. 9 is a flow diagram illustrating a method 900 for identifying anarea of interest in the composite image from images of differentwavelengths. At block 902, the multi-wave imaging application 210identifies an area of interest for an image corresponding to aparticular wavelength. In one example, the multi-wave imagingapplication 210 detects regions of interest based on the predefinedparameters or using a machine learning model. At block 904, themulti-wave imaging application 210 identifies the area of interest inthe composite image based on the identified area of interest in one ofthe images.

FIG. 10 is a flow diagram illustrating a method 1000 for generating amultimodal 3D overlay of diagnostic information in accordance with oneexample embodiment. At block 1002, the multi-wave imaging application210 performs a 3D reconstruction based on the overlaid images. At block1004, the multi-wave imaging application 210 generates a multi-model 3Doverlay of diagnostic information over visible light scan.

FIG. 11 illustrates a routine in accordance with one example embodiment.In block 1102, routine 1100 accesses sensor data from an optical arraysensor, the sensor data based on incoming light reflected off a specimenthat is illuminated with a plurality of light sources of differentwavelengths, each light source having a corresponding wavelength. Inblock 1104, routine 1100 forms a plurality of images based on the sensordata, each image being based on a wavelength of a corresponding lightsource. In block 1106, routine 1100 generates a composite image basedthe plurality of images, the composite image registering a same pixellocation in the composite image for the different wavelengths.

FIG. 12 illustrates a routine in accordance with one example embodiment.In block 1202, routine 1200 forms a first beam of light at a firstwavelength with a first light source. In block 1204, routine 1200 formsa second beam of light at a second wavelength with a second lightsource. In block 1206, routine 1200 combines the first beam of light andthe second beam of light into a single beam of light. In block 1208,routine 1200 illuminates a specimen with the single beam of light. Inblock 1210, routine 1200 detects, using an optical array sensor,reflected light that is reflected from the specimen. In block 1212,routine 1200 accesses sensor data from the optical array sensor. Inblock 1214, routine 1200 forms a first image and a second image based onthe sensor data, the first image being based on the first wavelength,the second image being based on the second wavelength. In block 1216,routine 1200 forms a composite image from the first image and the secondimage, the composite image registering a same pixel location in thecomposite image for both the first image and the second image.

FIG. 13 is a diagrammatic representation of the machine 1300 withinwhich instructions 1308 (e.g., software, a program, an application, anapplet, an app, or other executable code) for causing the machine 1300to perform any one or more of the methodologies discussed herein may beexecuted. For example, the instructions 1308 may cause the machine 1300to execute any one or more of the methods described herein. Theinstructions 1308 transform the general, non-programmed machine 1300into a particular machine 1300 programmed to carry out the described andillustrated functions in the manner described. The machine 1300 mayoperate as a standalone device or may be coupled (e.g., networked) toother machines. In a networked deployment, the machine 1300 may operatein the capacity of a server machine or a client machine in aserver-client network environment, or as a peer machine in apeer-to-peer (or distributed) network environment. The machine 1300 maycomprise, but not be limited to, a server computer, a client computer, apersonal computer (PC), a tablet computer, a laptop computer, a netbook,a set-top box (STB), a PDA, an entertainment media system, a cellulartelephone, a smart phone, a mobile device, a wearable device (e.g., asmart watch), a smart home device (e.g., a smart appliance), other smartdevices, a web appliance, a network router, a network switch, a networkbridge, or any machine capable of executing the instructions 1308,sequentially or otherwise, that specify actions to be taken by themachine 1300. Further, while only a single machine 1300 is illustrated,the term “machine” shall also be taken to include a collection ofmachines that individually or jointly execute the instructions 1308 toperform any one or more of the methodologies discussed herein.

The machine 1300 may include processors 1302, memory 1304, and I/Ocomponents 1342, which may be configured to communicate with each othervia a bus 1344. In an example embodiment, the processors 1302 (e.g., aCentral Processing Unit (CPU), a Reduced Instruction Set Computing(RISC) Processor, a Complex Instruction Set Computing (CISC) Processor,a Graphics Processing Unit (GPU), a Digital Signal Processor (DSP), anASIC, a Radio-Frequency Integrated Circuit (RFIC), another Processor, orany suitable combination thereof) may include, for example, a Processor1306 and a Processor 1310 that execute the instructions 1308. The term“Processor” is intended to include multi-core processors that maycomprise two or more independent processors (sometimes referred to as“cores”) that may execute instructions contemporaneously. Although FIG.13 shows multiple processors 1302, the machine 1300 may include a singleProcessor with a single core, a single Processor with multiple cores(e.g., a multi-core Processor), multiple processors with a single core,multiple processors with multiples cores, or any combination thereof.

The memory 1304 includes a main memory 1312, a static memory 1314, and astorage unit 1316, both accessible to the processors 1302 via the bus1344. The main memory 1304, the static memory 1314, and storage unit1316 store the instructions 1308 embodying any one or more of themethodologies or functions described herein. The instructions 1308 mayalso reside, completely or partially, within the main memory 1312,within the static memory 1314, within machine-readable medium 1318within the storage unit 1316, within at least one of the processors 1302(e.g., within the Processor's cache memory), or any suitable combinationthereof, during execution thereof by the machine 1300.

The I/O components 1342 may include a wide variety of components toreceive input, provide output, produce output, transmit information,exchange information, capture measurements, and so on. The specific I/Ocomponents 1342 that are included in a particular machine will depend onthe type of machine. For example, portable machines such as mobilephones may include a touch input device or other such input mechanisms,while a headless server machine will likely not include such a touchinput device. It will be appreciated that the I/O components 1342 mayinclude many other components that are not shown in FIG. 13. In variousexample embodiments, the I/O components 1342 may include outputcomponents 1328 and input components 1330. The output components 1328may include visual components (e.g., a display such as a plasma displaypanel (PDP), a light emitting diode (LED) display, a liquid crystaldisplay (LCD), a projector, or a cathode ray tube (CRT)), acousticcomponents (e.g., speakers), haptic components (e.g., a vibratory motor,resistance mechanisms), other signal generators, and so forth. The inputcomponents 1330 may include alphanumeric input components (e.g., akeyboard, a touch screen configured to receive alphanumeric input, aphoto-optical keyboard, or other alphanumeric input components),point-based input components (e.g., a mouse, a touchpad, a trackball, ajoystick, a motion sensor, or another pointing instrument), tactileinput components (e.g., a physical button, a touch screen that provideslocation and/or force of touches or touch gestures, or other tactileinput components), audio input components (e.g., a microphone), and thelike.

In further example embodiments, the I/O components 1342 may includebiometric components 1332, motion components 1334, environmentalcomponents 1336, or position components 1338, among a wide array ofother components. For example, the biometric components 1332 includecomponents to detect expressions (e.g., hand expressions, facialexpressions, vocal expressions, body gestures, or eye tracking), measurebiosignals (e.g., blood pressure, heart rate, body temperature,perspiration, or brain waves), identify a person (e.g., voiceidentification, retinal identification, facial identification,fingerprint identification, or electroencephalogram-basedidentification), and the like. The motion components 1334 includeacceleration sensor components (e.g., accelerometer), gravitation sensorcomponents, rotation sensor components (e.g., gyroscope), and so forth.The environmental components 1336 include, for example, illuminationsensor components (e.g., photometer), temperature sensor components(e.g., one or more thermometers that detect ambient temperature),humidity sensor components, pressure sensor components (e.g.,barometer), acoustic sensor components (e.g., one or more microphonesthat detect background noise), proximity sensor components (e.g.,infrared sensors that detect nearby objects), gas sensors (e.g., gasdetection sensors to detection concentrations of hazardous gases forsafety or to measure pollutants in the atmosphere), or other componentsthat may provide indications, measurements, or signals corresponding toa surrounding physical environment. The position components 1338 includelocation sensor components (e.g., a GPS receiver Component), altitudesensor components (e.g., altimeters or barometers that detect airpressure from which altitude may be derived), orientation sensorcomponents (e.g., magnetometers), and the like.

Communication may be implemented using a wide variety of technologies.The I/O components 1342 further include communication components 1340operable to couple the machine 1300 to a network 1320 or devices 1322via a coupling 1324 and a coupling 1326, respectively. For example, thecommunication components 1340 may include a network interface Componentor another suitable device to interface with the network 1320. Infurther examples, the communication components 1340 may include wiredcommunication components, wireless communication components, cellularcommunication components, Near Field Communication (NFC) components,Bluetooth® components (e.g., Bluetooth® Low Energy), WiFi® components,and other communication components to provide communication via othermodalities. The devices 1322 may be another machine or any of a widevariety of peripheral devices (e.g., a peripheral device coupled via aUSB).

Moreover, the communication components 1340 may detect identifiers orinclude components operable to detect identifiers. For example, thecommunication components 1340 may include Radio Frequency Identification(RFID) tag reader components, NFC smart tag detection components,optical reader components (e.g., an optical sensor to detectone-dimensional bar codes such as Universal Product Code (UPC) bar code,multi-dimensional bar codes such as Quick Response (QR) code, Azteccode, Data Matrix, Dataglyph, MaxiCode, PDF417, Ultra Code, UCC RSS-2Dbar code, and other optical codes), or acoustic detection components(e.g., microphones to identify tagged audio signals). In addition, avariety of information may be derived via the communication components1340, such as location via Internet Protocol (IP) geolocation, locationvia Wi-Fi® signal triangulation, location via detecting an NFC beaconsignal that may indicate a particular location, and so forth.

The various memories (e.g., memory 1304, main memory 1312, static memory1314, and/or memory of the processors 1302) and/or storage unit 1316 maystore one or more sets of instructions and data structures (e.g.,software) embodying or used by any one or more of the methodologies orfunctions described herein. These instructions (e.g., the instructions1308), when executed by processors 1302, cause various operations toimplement the disclosed embodiments.

The instructions 1308 may be transmitted or received over the network1320, using a transmission medium, via a network interface device (e.g.,a network interface Component included in the communication components1340) and using any one of a number of well-known transfer protocols(e.g., hypertext transfer protocol (HTTP)). Similarly, the instructions1308 may be transmitted or received using a transmission medium via thecoupling 1326 (e.g., a peer-to-peer coupling) to the devices 1322.

Although an embodiment has been described with reference to specificexample embodiments, it will be evident that various modifications andchanges may be made to these embodiments without departing from thebroader scope of the present disclosure. Accordingly, the specificationand drawings are to be regarded in an illustrative rather than arestrictive sense. The accompanying drawings that form a part hereof,show by way of illustration, and not of limitation, specific embodimentsin which the subject matter may be practiced. The embodimentsillustrated are described in sufficient detail to enable those skilledin the art to practice the teachings disclosed herein. Other embodimentsmay be utilized and derived therefrom, such that structural and logicalsubstitutions and changes may be made without departing from the scopeof this disclosure. This Detailed Description, therefore, is not to betaken in a limiting sense, and the scope of various embodiments isdefined only by the appended claims, along with the full range ofequivalents to which such claims are entitled.

Such embodiments of the inventive subject matter may be referred toherein, individually and/or collectively, by the term “invention” merelyfor convenience and without intending to voluntarily limit the scope ofthis application to any single invention or inventive concept if morethan one is in fact disclosed. Thus, although specific embodiments havebeen illustrated and described herein, it should be appreciated that anyarrangement calculated to achieve the same purpose may be substitutedfor the specific embodiments shown. This disclosure is intended to coverany and all adaptations or variations of various embodiments.Combinations of the above embodiments, and other embodiments notspecifically described herein, will be apparent to those of skill in theart upon reviewing the above description.

The Abstract of the Disclosure is provided to allow the reader toquickly ascertain the nature of the technical disclosure. It issubmitted with the understanding that it will not be used to interpretor limit the scope or meaning of the claims. In addition, in theforegoing Detailed Description, it can be seen that various features aregrouped together in a single embodiment for the purpose of streamliningthe disclosure. This method of disclosure is not to be interpreted asreflecting an intention that the claimed embodiments require morefeatures than are expressly recited in each claim. Rather, as thefollowing claims reflect, inventive subject matter lies in less than allfeatures of a single disclosed embodiment. Thus, the following claimsare hereby incorporated into the Detailed Description, with each claimstanding on its own as a separate embodiment.

EXAMPLES

Example 1 includes a method comprising: forming a first beam of light ata first wavelength with a first light source; forming a second beam oflight at a second wavelength with a second light source; combining thefirst beam of light and the second beam of light into a single beam oflight; illuminating a specimen with the single beam of light; detecting,using an optical array sensor, reflected light that is reflected fromthe specimen; accessing sensor data from the optical array sensor;forming a first image and a second image based on the sensor data, thefirst image being based on the first wavelength, the second image beingbased on the second wavelength; and forming a composite image from thefirst image and the second image, the composite image registering a samepixel location in the composite image for both the first image and thesecond image.

Example 2 includes example 1, wherein illuminating the specimen furthercomprises: illuminating a digital micro-mirror device (DMD) array withthe single beam of light, the single beam of light corresponding to asingle pixel of the optical array sensor; controlling the DMD array witha DMD controller (to form a pattern of light); forming a pattern oflight with the DMD controller, the pattern of light corresponding to anarray of pixels; and projecting the pattern of light onto the specimen.

Example 3 includes any of the above examples, wherein a first sensorfrom the optical array sensor is configured to detect light at the firstwavelength, wherein a second sensor from the optical array sensor isconfigured to detect light at the second wavelength.

Example 4 includes any of the above examples, wherein the specimencomprises a tooth, wherein the first wavelength comprises human-visiblelight wavelength, wherein the second wavelength is at 900 nm or 1450 nm.

Example 5 includes any of the above examples, further comprising:identifying dental caries in the second image; and indicating the dentalcaries in the composite image.

Example 6 includes any of the above examples, further comprising:generating a first plurality of images based on the first wavelength;generating a second plurality of images based on the second wavelength;and generating a three-dimensional model of the specimen based on thefirst and second plurality of images.

Example 7 includes any of the above examples, further comprising:identifying a region of interest in the second image; and indicating theregion of interest in the composite image.

Example 8 includes an imaging system comprising: a first light sourceconfigured to form a first beam of light at a first wavelength; a secondlight source configured to form a second beam of light at a secondwavelength; a beam combiner configured to combine the first beam oflight and the second beam of light into a single beam of light and toilluminate a specimen with the single beam of light; an optical arraysensor configured to detect reflected light that is reflected from thespecimen; and a computing device coupled to the optical array sensor andconfigured to: access sensor data from the optical array sensor; form afirst image and a second image based on the sensor data, the first imagebeing based on the first wavelength, the second image being based on thesecond wavelength; and form a composite image from the first image andthe second image, the composite image registering a same pixel locationin the composite image for both the first image and the second image.

Example 9 includes any of the above examples, further comprising: adigital micro-mirror device (DMD) array configured to illuminate thespecimen with the single beam of light, the single beam of lightcorresponding to a single pixel of the optical array sensor; and a DMDcontroller configured to control the DMD array, to form a pattern oflight, the pattern of light corresponding to an array of pixels, and toproject the pattern of light onto the specimen.

Example 10 includes any of the above examples, wherein a first sensorfrom the optical array sensor is configured to detect light at the firstwavelength, wherein the second sensor from the optical array sensor isconfigured to detect light at the second wavelength.

Example 11 includes any of the above examples, wherein the specimencomprises a tooth, wherein the first wavelength comprises human-visiblelight wavelength, wherein the second wavelength is at 900 nm or 1450 nm.

Example 12 includes any of the above examples, wherein the computingdevice is further configured to: identify dental caries in the secondimage; and indicate the dental caries in the composite image.

Example 13 includes any of the above examples, wherein the computingdevice is further configured to: generate a first plurality of imagesbased on the first wavelength; generate a second plurality of imagesbased on the second wavelength; and generate a three-dimensional modelof the specimen based on the first and second plurality of images.

Example 14 includes any of the above examples, wherein the instructionsfurther configure the apparatus to: identify a region of interest in thesecond image; and indicate the region of interest in the compositeimage.

Example 15 includes an imaging system comprising: a multi-spectrum lightsource configured to form and direct a beam of light at multiplewavelengths at a specimen; a beam combiner that combines reflected lightfrom the specimen into a single beam of light; a first optical filterconfigured to filter the single beam of light at a first wavelength; asecond optical filter configured to filter the single beam of light at asecond wavelength; a first array sensor configured to detect thefiltered single beam of light at the first wavelength from the firstoptical filter; a second array sensor configured to detect the filteredsingle beam of light at the second wavelength from the second opticalfilter; a computing device coupled to the first and second array sensorconfigured to: access first sensor data from the first array sensor;access second sensor data from the second array sensor; form a firstimage based on the first sensor data, the first image corresponding tothe first wavelength; form a second image based on the second sensordata, the second image corresponding to the second wavelength; and forma composite image from the first image and the second image, thecomposite image registering a same pixel location in the composite imagefor both the first image and the second image.

Example 16 includes any of the above examples, wherein the specimencomprises a tooth, wherein the first wavelength comprises human-visiblelight wavelength, wherein the second wavelength is at 900 nm or 1450 nm.

Example 17 includes any of the above examples, wherein the computingdevice is further configured to: identify dental caries in the secondimage; and indicate the dental caries in the composite image.

Example 18 includes any of the above examples, wherein the computingdevice is further configured to: generate a first plurality of imagesbased on the first wavelength; generate a second plurality of imagesbased on the second wavelength; and generate a three-dimensional modelof the specimen based on the first and second plurality of images.

Example 19 includes any of the above examples, wherein the beam combinercomprises an optical lens, wherein the first array sensor comprises afirst two-dimensional optical sensor, wherein the second array sensorcomprises a second two-dimensional optical sensor.

Example 20 includes any of the above examples, wherein the first opticalfilter comprises a first semi-transparent mirror that filters everywavelengths except for the first wavelength, wherein the second opticalfilter comprises a second semi-transparent mirror that filterswavelengths based on the first wavelength.

What is claimed is:
 1. An imaging system comprising: a multi-spectrumlight source configured to form and direct a beam of light at multiplewavelengths at a specimen; a lens that combines reflected light from thespecimen into a single beam of light along a single axis; a firstoptical filter disposed adjacent to the lens along the single axis andconfigured to filter e single beam of light at a first wavelength; asecond optical filter disposed adjacent to the first optical filteralong the single axis and configured to filter the single beam of lightat a second wavelength; a first array sensor configured to detect thefiltered single beam of light at the first wavelength from the firstoptical filter; a second array sensor configured to detect the filteredsingle beam of light at the second wavelength from the second opticalfilter; a computing device coupled to the first and second array sensorconfigured to: access first sensor data from the first array sensor;access second sensor data from the second array sensor; form a firstimage based on the first sensor data; the first image corresponding tothe first wavelength; form a second image based on the second sensordata; the second image corresponding to the second wavelength; and forma composite image from the first image and the second image, thecomposite image registering a same pixel location in the composite imagefor both the first image and the second image.
 2. The imaging system ofclaim 1, wherein the specimen comprises a tooth, wherein the firstwavelength comprises human-visible light wavelength, wherein the secondwavelength is at 900 nm or 1450 nm.
 3. The imaging system of claim 2,wherein the computing device is further configured to: identify dentalcaries in the second image; and indicate the dental caries in thecomposite image.
 4. The imaging system of claim 1, wherein the computingdevice is further configured to: generate a first plurality of imagesbased on the first wavelength; generate a second plurality of imagesbased on the second wavelength; and generate a three-dimensional modelof the specimen based on the first and second plurality of images. 5.The imaging system of claim 1, wherein the first array sensor comprisesa first two-dimensional optical sensor, wherein the second array sensorcomprises a second two-dimensional optical sensor.
 6. The imaging systemof claim 1, wherein the first optical filter comprises a firstsemi-transparent mirror that filters every wavelengths except for thefirst wavelength, wherein the second optical filter comprises a secondsemi-transparent mirror that filters wavelengths based on the firstwavelength.
 7. A method comprising: directing a beam of light atmultiple wavelengths, from a multi-spectrum light source, towards aspecimen; combing reflected light from the specimen into a single beamof light with a lens disposed along a single axis of the single beam oflight; filtering the single beam of light at a first wavelength with afirst optical filter that is disposed adjacent to the lens along thesingle axis; filtering the single beam of light at a second wavelengthwith a second optical filter that is disposed adjacent to the firstoptical filter along the single axis; detecting, with a first arraysensor, the filtered single beam of light at the first wavelength fromthe first optical filter; detecting, with a second array sensor, thefiltered single beam of light at the second wavelength from the secondoptical filter; accessing first sensor data from the first array sensor;accessing second sensor data from the second array sensor; forming afirst image based on the first sensor data; forming a second image basedon the second sensor data; and forming a composite image from the firstimage and the second image, the composite image registering a same pixellocation in the composite image for both the first image and the secondimage.
 8. The method of claim 7, wherein the specimen comprises a tooth,wherein the first wavelength comprises human-visible light wavelength,wherein the second wavelength is at 900 nm or 1450 nm.
 9. The method ofclaim 8, further comprising: identifying dental caries in the secondimage; and indicating the dental caries in the composite image.
 10. Themethod of claim 7, further comprising: generating a first plurality ofimages based on the first wavelength; generating a second plurality ofimages based on the second wavelength; and generating athree-dimensional model of the specimen based on the first and secondplurality of images.
 11. The method of claim 7, wherein the first arraysensor comprises a first two-dimensional optical sensor, wherein thesecond array sensor comprises a second two-dimensional optical sensor.12. The method of claim 7, wherein the first optical filter comprises afirst semi-transparent mirror that filters every wavelengths except forthe first wavelength, wherein the second optical filter comprises asecond semi-transparent mirror that filters wavelengths based on thefirst wavelength.